Andrew Bailey Denies Being 'Unreliable Boyfriend' After Not Raising Rates